To break or spoil something, or make it inoperative, useless etc.
I've buggered up the sudoku somehow and can't finish it.